~ 


* 


+ BD 167 591 


AGTH OR 
TITLE 


PUB DATE . 
NOTE 


ED RS CE 


DE SCRI PMFOR S’ 


IDENTIPIERS 


ABSTRACT 


. 
; E ‘ 
\ ’ : ans 


\DOCONENT BESUHE = Y has 
a : moog 368 
Lewis, Jack L. 
Problems Encountered in cevbuoedng an Assesement of : 
' Bducational Needs in Selected Chio School § “% ’ i 
Districts. 
Mar 78 


11p.3 Paper resented at the Annual Heeting of the 
American Educational Research Association (62nd, 
mereniey Ontario, Canada, farch areas 1978) ’ 


HP- -$0. 83 HC- $1.67 Plus Postage. 
*Administrative Problems; *F&ducational Needs; 


- Elementary Secondary Education; Financial Frableas; a 


*School Districts; State Surveys; Student Needs; 
Testing Probleas \ 


‘Ohio 


o . 
> 


Five Ohio school districts, both large and. small, 


participated in a year-long needs- assessment study, follcwirg 
activities specified in the Ohio Needs Assessment Guidelines. - 
Following interviews with the needs assessment coordinatcr at each | 
district, researchers summarized proktlem areas. related tc each of 15 
activities corresponding to the eight tajer stere of the Guidelines. 
Activities were considered problematic if their completicr required. 
more time, money or professional expertise than anticipated, or did. 
not conform to procedures specified in the Guidelines. activities 
frequently cited as problems were: (1) obtaining a reascrable 
response’ rate for the community survey; (2) identifying gcals; (3) 
determining sub-goals; and (4) preparing the survey instrument. 
‘Despite the fact that districts had access to consultants, state 
qrants to cover costs, and Guidelines, the needs assesspert was 


difficult, 


expensi and time consusirg. The importance of-setting 


qoals, committing time and money, hiring a ccnsultant, and training a 
staff member to coordinate needs assessment were reccamended. 
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ABSTRACT 


% 
The purpose of this study was to gather information about the technical 


and administrative problems encountered by school personnel as they attempted 


> 
. 


to conduct an assessment of educational needs. Five Ohio school districts 
ranging in size from very small (under 3,000 students K-12) to very large 
(more than 25,000 students K-12) participated in the year-long study. The 
“general procedure uséd to assess needs was the — in each school district. 


s 


Results of the study showed that school personnel in the five school 


, 


oy ; . = de 
districts encountered numerous and severe problems in completing the needs 


assessment activities. 


Skee 
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Introduction 


The literature regarding educational planning points out the importance 
of determining student educational needs as an early step in the planning 
process. Potential benefits from a systematic axeaedunmiit of student needs 
are many, including a ranking of top priority needs in a given instructional _ 
setting and the active, involvement of school and community personnel in edu- 
cational planning. 
Despite the many potential benefits, use of a systematic procedure to 
assess educational néeds 4 not commonplace in ‘schools. In discussing a 
procedure for needs nencenmene at the school district level, Jones and Sommers 
(1975) state chee needs Goueaciuaut is a process that is much discussed but 
rarely implemented in a systematic way in a public school system. Some 
possible explanations for this ditvarion are (1) lack of familiarity with 
needs assessment techniques on the part of school personnel, (2) concerns of 
administrators about the amount of time, expense, and expertise required to 

- conduct a needs assessment, and (3) the number of technical and administrative 
problems which need to be overcome to conduct a needs assessment. 

In this study, it was eam ag gather inforusetod about the technical 
and administrative problems associated with a needs assessment by monitoring 
the implementation of a prepared needs assessment siicadinie in five Ohio 
school districts. The procedure followed in these districts is described in 
the Ohio Needs Assessment Guidelines, a publication by the Ohio Department of 
Education. In addition, information was collected iboue the level of expendi- 
baw: amount of professional and clerical staff time, and amount of cgnsultant 


assistance needed to complete the needs assessment. 


The study was conducted during the 1975-96 school year. 
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_ Background of the Study 


Administrative personnel in the five districts which participated in 


this study had indicated their’ interest in conducting a needs assessment by 


submitting applications to the Ohio Department of Education for funds desig- ] 
nated for needs assessment activities. These five ddetricte were among 
thirteen districts which actually received grants from these special funds. 
Grants awarded to the five districts ranged in size from waprostaately $10,000 
to $24,000. As part of the grant terms and conditions, the districts had to 
* partially match the funds with in-kind contributions (e.g., professional and 
clerical staff time) .: The effective grant period was from June 1, 1975 to 
June 30, 1976. ) 
As an additional condition for these grants, the districts were required 


to implement the needs assessment procedure described in the Ohio Needs Assess- 


+ 


ment Guidelines. This proceduré consisted of the falgowing steps: 
y i. Establish a needs assessment committee. 

2.\ Prepare statements of educational goals. oy 

3. \ Conduct a survey to determine cbvceivad educational needs. 

4. sign priorities to perceived educational needs. 


5. Set desired levels of student achievement’ on top priority a 
perceived needs. : 


* 6. Ascertain actual status of student achievement. 


7. Compare actual status with desired levels of student achievement. 


&. 


8. Assign priorities to educational needs. 
This procedure was to be implemented on a district-wide basis. 

The guidelines providedinstructions for completing each of these steps. 
In addition, districts were permitted to obtain consultant assistance with 


grant funds. District personnel were not given training in the needs assess- 


od . , i . : | , - 7s ; 
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t procedure as part of the process for administering the grants jat the 
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state level. 
: 
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Student enrollment in the five districts ranged’ from very small (fewer. 


chan 3,000 elenta 12153 to very large (more than 25,000 students K-12). 
District personnel Hines assigned to coordinate checunada assessment activ- 
ities varied considerably in the level of training and experience a research 
and’ evaluation techniques. Those personnel in the smaller districts had 
little or no such training while those in the meus districts had graduate 


level training and experience in these areas. 
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Procedure ‘" : 


« 


The bulk of the data needed to complete the study was collected through 
two personal interviews with the needs acnektesnt coordinator at each district. 
Using a prepared questionnaire, the researcher asked the coordinators about 
the actual needs assessment activities they had sanddeted and mei the prob- 
iva areas they had encountered. The firet interview was held about aiaway 
through the needs assessment with the second interview being held following 
the completion of needs assessment activities. , 

Following the interviews, the disbise areas at each test site were con- *s 
tent analyzed by the researcher. © A summary was made of the problem areas 
related to each of 15 specific ‘activities which made up the eight ‘major steps 
of the needs assessment procedure. ‘These activities were considered problem 


areas if they met one or-more of the following conditions: 


a. Completion of the activity required more time and/or money than 
was anticipated by the needs assessment director. 


b. Completion of the actiyity required professional expertise not 
available at the test site. 


c. The activity could not be completed to the satisfaction of the 
needs assessment director. 


d. The activity could not be completed using procedures specified 
in the Ohio Needs Assessment Guidelines. 
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cneleaaiae> “atammicnds needed to complete the study was collected from 
i) cheers and other documents generated by each district during the seals | 
assessment. ~ | 
Results | 


Table 1 shows the activities which were considered problem areas at each 
yh 

district (site). As indicated in Table l, personnel at each district encoun- 
tered prdblems during the needs assessment, and each needs waecdaaant activity| 
with but, one exception was considered a problem area in at least one district.) 
As is also indicated by-Table 1, two of the -districts did not complete all NX 
of th -hetivities during the year in which this study was conducted. 
e ng the activities that were completed at all test sites, specific 
“A activities which were considered most frequently as problem areas were (1) 
obtaining a reasonable response rate from parents and sscauneey members when 
conducting the suevey: (2) identifying educational goals, (3) determining 
sub-goals, and (4) preparing the survey instrument. Setting desired levels 
of student performance and selecting adequate assessment instruments were 
considered problem areas at two of the three sites completing these activities. 
Two of the test sites did not complete these two activities. 

Amor the activities that were completed at all test sites, those activ- 
ities which were considered least Fenuenbio as problem areas were (1) admini- 
stering the survey instrument, (2) derersin lng the weighting procedure used 
in analyzing the data, (3) ranking the perceived needs, and (4) selecting 
evden for further assessment. Comparing desired levels with assessment results 
was not considered a problem area at any of the three sites completing this 
activity. Two of the test sites did not comp tere this activity. F 


In addition to the technical problems with the needs assessment activities, 


the needs assessment coordinators experienced other problems related to admini- 


‘ 


Table l. Problem Areas Encountered at Each Test Site. ° 


Needs Assessment 
Activities 


* Appointing a Needs 
Assessment Committee 


Identifying Goals 


‘ 


Determining Sub-Goals 


Preparing Survey 
Instrument 


Administering the 
Instrument 


Obtaining Reasonable 
Response Rate 


Analyzing the Survey 
Data 


Determining Weighting 
Procedures 


Ranking Perceived 
Needs 


Selecting Areas for 
Further Assessment 


Setting Desired 
Performance Levels 


Selecting Adequate 
Assessment Instrument 


Conducting Actual 
Aiacaiend 


Comparing Desired and 
Actual Levels 


Ranking Actual Need 
Areas \ 


a Key: Yes indicates the 


No indicates the 
N.C. indicates the 


b Site 1 is a large urban 


school district, Site 3 


district, Site 5 is a medium-sized subutban school district. 


— 
f PROBLEM AREAS?» 
Sited Site Site _ Site Site 
1- 2 3 . 4 5 
No No Yes Yes No 
Yes Yes No No Yes 
Yes Yes No No Yes 
Yes : Yes Yes No Yes 
Yes No No No No 
, ‘ 
Yes Yes Yes No Yes 
No Yes No Yes No 
No No No No Yes 
No Yes No : No No 
No Yes No No lo J 
e 
Yes Yes N.C. No N.C. 
Yes Yes N.C No N.C. 
Yes No N.C No N.C 
No No N.C. No N.C 
a 
# 
No Yes N.C No N.C. 


activity was a problem. 
activity was not a problem. 
activity was not completed. 


school district, Site 2 is a small rural-suburban 
is a small rural district, Site 4 is a small rural 
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stration of the various activities- ‘All of the coordinators felt that the 


time required to coordinate the needs assessment. achivities was much greater 
than they had anticipated. As a result, the implementation of the needs 
assessment fell behind schedule. “At two of the districts, the heeds ‘ineedas 
ment had not been completed by the end of the grant period. 

Another problem experienced at many of the districts was that of working 
with the needs assessment committee. This isaabecee was Ga he made up of . 
representatives of various school and community groups and was se ite the 
reaponsibility for making many of the npidtdua sepuithe the needs assess- 
ment’ (e.g., grade level to be assessed, preparation of goals,’ and selection 
of top priority needs). The coordinators found it artereare to convene the 
committees as often as needed and * have good dpeasaage at the meeting. As 


a result, the coordinators found it necessary to make many of the decisions | 


without proper input from me committee members. 

The coordinators also experienced some problems with the hei maneendant 
because of their lack of experience with such activities. _This was especially 
apparent in the districts which did not have personnel with training and exper- 
fence 1 educational research and seeiinaeied techniques. 


The amount of time spent by various tte. the total cost of the 


needs assessment at each site are shown’ in Table 2. he stated costs do not 


r 


Table 2. Time and Costs Required to Complete the Needs Assessment at Each 


District. 
Coordinators' Clerical Consultant 

District Time Time ‘ Time * Total Cost 

Site l © 270 hrs. 480 hrs. 16 hrs. , $23,431 

Site 2 320 hrs. 320 hrs. 56 hrs. 15,613 

Site 3 80 hrs. 80 hrs. O hrs. 5,526 

Site 4 360 hrs. 0 hrs. 50 hrs. 10,715 ‘ 
Site 5 - 100 hrs. 120 hrs. O hrs. a 
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97 


‘indélude the cost of the cootdinators' time as this pas considered an in-kind 


contribution to the needs asseBsment project. . 


Summa Discussion and Recommendations 


Results of this study showed that numerous technical and administrative 
problems were encountered by school district personnel as they conducted a 
systematic assessment of student educational needs. Specific needs assessment . 
activities which created especially difficult problems for school personnel 
were (1) surveying community perceptions of needs, (2) establishing educational 


aculay 1% specifying.desired levels of student performance, and (4) assessing 


student performance. The various administrative problems encountered during 


. 


the needs assessment resulted in serious slippage of timelines and non-completion . 


\ ‘ { 


of ghe needs assessment in two of the five districts. as 


It is important to note that these problems were encountered even though 


‘conditions for conducting the needs assessment were nearly ideal. The districts 
iad funds from special state grants to Sse costs involved with the vere 
assessment. Consultant assistance could be obtained with the funds so lack of 
expertise on he part of school personnel did not have to hinder the effort. 
School officials in preparing thge grant applications had stated specific reasons 
why they were interested in conducting a daeas assessment and had committed 
relatively large ‘estan ie staff time to the Bese assessment activities. A 
prepared needs assessment procedure with instructions for its completion was, 
available to guide school personnel. i rap 

Even under bhege conditions, school personnel encountered numerous and 
severe problems in conducting the needs assessment. The findings indicate 
that a systematic assessment of student educational needs is a difficult, 
: expensive, and ee bacucnwietng er It seems likely that this type of 


needs assessment will not be a part of the planning seseaes in most school 


districts. 
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a a Po] 2 ; ’ 
For school districts which wish to follow the needs assessment procedure ,/ 


used by the districts participating in this study, the following recommendations . 
are given: ‘ 
a. A list of educational, goals should be prepared to serve as a 
‘ basis for the needs assessment. Z 
b.. School officials should be willing to commit an adequate level < 
of staff time and financial resources to the needs assessment 
effort. (Findings from this study suggest that a 25% to 50% Fm ag 
time coordinator and from $10,000 to $25, 000 eee funds 
‘will be required. ) a ; 


% 


‘ 


c. A trained ‘consultant shoyld,be hifed to agsist with specific 
needs assessment praia Secetine expertise not available in the 
school system. 

d. Coordinators of the needs assessment should attend a workshop 
session on needs assessment activities prior to initiating the 
needs assessment. ‘ zi 
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